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ABSTRACT 



An interactive electronic shopping system and method cre- 
ate a virtual shopping facility from an actual shopping 
faciUty, such as a grocery store, restaurant, or office. A 
shopper at a computer or other suitable display device can 
move through the virtual shopping facility and see replicas 
of what would be seen in moving through the actual shop- 
ping facility. Various lists of items selected for purchase can 
be made, and predetermined lists and information can be 
displayed. Changes in the actual shopping facility, such as a 
change in a display of goods, can be accommodated by 
replacing prior data with new data so that the virtual 
shopping environment is kept current with the actual shop- 
ping facility, 

7 Claims^, 7 Drawing Sheets 
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INTERACTIVE ELECTRONIC SHOPPING shopping facility into encoded digital signals representing 

SYSTEM AND METHOD the images as would be seen by a shopper at a physical 

embodiment of the shopping facility; means for storing the 

This appUcation is a continuation of copending appUca- encoded digital signals in a computer data base; means for 

tion Ser. No. 08/838,087 filed on Apr. 15, 1997. 5 displaymg a video representation of the shoppmg facility in 

response to the stored encoded digital signals; and control 

BACKGROUND OF THE INVENTION means for the shopper to control the means for displaying 

such that the means for displaying causes the displayed 

This invention relates generally to interactive electronic video image to change at the shopper's command to corre- 

shopping systems and methods and more particularly, but spond to what the shopper would see were the shopper to 

not by way of limitation, to such systems and methods move through a physical embodiment of the shopping 

utilizing the Internet so that an individual shopper can access facility. 

shopping information from his or her home or office, for In a particular implementation, the interactive electronic 

example. shopping system comprises: a digital camera to digitize a 

Commercial use of the Internet, and particularly the 15 shopping facility into digital signals representing images of 

World Wide Web, presently allows some degree of investi- the shopping facility; a central computer data base to store 

gation and ordering of products offered for sale. The con- the digital signals; a communication link connected to the 

venience that this can offer to a shopper would be enhanced central computer data base; a local computer connected to 

with regard to at least some types of shopping if the shopper the communication link; and a control interface connected to 

could see a virtual reproduction of an actual store and the 20 the local computer to enable a shopper to control the local 

products offered there as they arc actually displayed at the computer such that the local computer obtains data from the 

store. Convenience would also be enhanced if the shopper central computer data base in response to the digital signals 

could examine the displayed products in a manner similar to stored therein and displays video images of the shopping 

how one would at the actual store. facility in response to the obtained data. 

Further convenience would be added by creating one or 25 The present invention also provides a method of creating 
more lists of what the shopper may need to buy based upon a virtual shopping facility for interactive shopping by corn- 
historical or predetermined ordering patterns or upon actual P^ter. This method comprises: selecting a physically embod- 
selections at the time the shopper is moving through the ied shopping facility in which a shopper can purchase from 
virtual store shown on the shopper's display. among a plurality of products; converting images of at least 

Thus, there is the need for a video-based digitally imple- 30 a portion of the shopping facility and the plurality of 

mented interactive electronic shopping system which allows P^^^f'^f ^ ^"""^"^^ "^'^^^ ^°^5?^^ 

a customer to view the contents of a particular shopping ^'^'^^ ^'^""^^^ ^ computer storage medium; and providing 

facility in a format that provides the feeUng of shopping for access to the stored encoded digital signals such that por- 

the items in that particular facility. Use of this should be ^^^^^^^^^^ digital signals are selectable and 

available at the customer's home or business through a 35 transmissible to a computer for displaying, on a monitor of 

convenient device, such as a personal computer, television the computer, virtual movement withm a visual representa- 

or other consumer type electronic visual display device. tion of the shoppmg facility and for permitung examination 

of visual representations of selected products m response to 

SUMMARY OF THE INTVENTION selected stored encoded digital signals. 

40 The present invention also provides a computer- 

The present invention provides a novel and improved implemented method of simulating movement of a shopper 
interactive electronic shopping system and method thai through a shopping facility to enable an individual to 
satisfy the aforementioned needs for making shopping more observe, inspect and select a product in the shopping facility 
convenient to the shopper. Using the present invention, a through operation of a computer. The method comprises: 
shopper can browse through a virtual duplicate of an actual selecting a shopping facility having a known configuration 
store in a manner similar to being in the actual store itself. of products displayed at the selected shopping facility such 
The shopper can examine individual products, and select or that a shopper can move among the displayed products to 
not select ones for purchase. Through the selection process, observe, inspect and select from among the displayed prod- 
one or more types of lists can be created (e.g., alphabetical ^cts; simulating the configuration of displayed products in a 
or by location in the store). Historical lists based on past computer, including translating the known configuration of 
ordering and predetermined buying frequency can also be displayed products into encoded configuration-defining 
provided. Special displays or information can also be pro- electrical signals in memory of a first computer and using the 
vided to alert the shopper to specials on particular products. electrical signals to create in a second computer video 
Products can be located through a directory that correlates representations of the configuration of displayed products; 
all the products with their respective locations in the store, 55 indicating to at least the second computer a first position of 
Changes at the actual store can be implemented in the virtual ^ shopper in the shopping facility and displaying through a 
store. monitor of the second computer the video representation of 

This invention benefits the marketer of the products the configuration of displayed products at the first position; 
because, for example, it allows for customer loyalty to be and indicating to at least the second computer a continuous 
developed since the exact depiction of the marketer's store go change from the first position to a second position and 
actually enables the customer to become very familiar with displaying through the monitor of the second computer a 
the store and its particular products and to stay abreast of changing video representation of the configuration of dis- 
changes. It also enables a customer to reduce the actual played products corresponding to a moving scene the shop- 
shopping time and to ease or enhance the shopping experi- per would see in moving from the first position to the second 
ence, 65 position in the shopping facility. 

An interactive electronic shopping system of the present The present invention still further provides a computer- 
invention comprises: means for converting images of a implemented method of making a shopping list for purchas- 
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ing products from a shopping facility, comprising perform- group of items. By "mouse** double click or touch of an 

ing each of the following steps using a computer: accessing indicator on the hot spot, for example, a portion of the screen 

a predetermined data base of encoded electrical signals displays additional information conceming the item, 

representing a shopping facility and products available for The additional information conceming an item includes 

purchase from the shopping facility; retrieving from the data 5 any information desired. Examples are product size, price, 

base a sequence of the encoded electrical signals and dis- unit price, last purchase date, location in the store, additional 

playing moving images of at least a portion of the shopping product advertisement including audio information, infor- 

facility and products to simtilate movement through the mation concerning other sizes or related products available 

portion of the shopping facility in response to the retrieved and a "yes" or "no" to order or place an item on a list From 

sequence of encoded electrical signals; and selecting dis- lO the running list of items selected for purchase, additional 

played products and making a list of the selected displayed lists can be automatically created. One such list coidd 

products, include a list of items ordered with the cost of each, the 

Therefore, from the foregoing, it is a general object of the running total cost, and store location. A hst arranged in order 

present invention to provide a novel and improved interac- of store location could be selected for use in speeding time 

tive electronic shopping system and method. Other and required for obtaining the items while in the actual store. If 

further objects, features and advantages of the present inven- the order is to be filled by another party, the list could order 

tion will be readily apparent to those skilled in the art when the items for selecting from a warehouse or other storage 

the following description of the preferred embodiments is location. Items which must be weighed or selected on a 

read in conjunction with the accompanying drawings. weight basis could be estimated based upon prior purchase 

20 history. Unique items such as flowers or vegetables could be 

BRIEF DESCRIPTION OF THE DRAWINGS ordered by category, number, and total cost or amount 

FIG. 1 is a block diagram of the preferred embodiment required (if applicable). 

P Additional lists can be automaUcally available at the 

system of the present mvention. ... ^ t • • , , . • 

r - , ■ . - beginning ot the interactive virtual shopping session. Inese 

FIG. 2 IS a block digram of a particular implementatioD zs jj^dudc pre-prepared lists of items routinely purchased, 

of the preferred embodiment system of the present mven- ^^^^ purchased in the past, and items due for reorder based 

on prior purchase history. 

FIG. 3 is a representation of an illustrative screen display p^^^^ invention is to aUow persons that 

at a local computer of the particular implementation of FIG. ^^^^j ^^^^ ^ ^^^^^ ^^^^^ 

^ 30 

electronically to a store where personnel will select the items 

FIG. 4 is a representation of another illustrative screen and either deliver them or hold them for pick up by the 

display at the local computer represented in FIG. 3. customer. Automatic electronic payment capability is pref- 

FIGS. 5 and 6 are representations of alternatives for the erably also available as a part of the order process, 

screen display of FIG. 4. The present invention enables pre -shopping of a particular 

FIG. 7 is a representation of still another illustrative store in the comfort of one's home, office or any location 

screen di^lay at the local computer represented in FIG. 3. where a suitable electronic interface, (e.g., a computer 

FIG. 8 is a representation of a further illustrative screen having Internet access capability) is available. TTie informa- 

display at the local computer represented in FIG. 3. ^ion can be searched, selected and lists prepared for use 

™^ n • . £ ^•^^cL^l. -n * *• Ar, while io the store, thereby reducidg the shopping time. It 

FIG. 9 IS a representation of a still further illustrative 40 ' e -i- i 

... . Tu 1 1 . .J- i-ii^ -7 also allows someone uniamiliar with the particular custom- 
screen display at the local computer represented in FIG. 3. , j • r -i- * * £c • *i j *u 
^ 1' f g,.'5 desires or unfamiuar with the store to efinciently do the 

FIGS. lOA-lOB show a flow chart of part of the method actual shopping using the lists produced, 

of the present invention. invention has particular application to any provider 

DETAILED DESCRIPTION OF THE ^5 goods or services where customers, clients or patients 

INVENTION typically go to an actual shop, office or other physical 

facility. It is especially applicable to any merchandiser of 

Overview consumer products including grocery stores, mass merchan- 

A digital camera provides an inexpensive and versatile disers of consumer goods such as variety or department 
way for a store owner to electronically capture images of the 50 stores, drug stores and other similar stores selling many 
store's contents for computerized interactive viewing by its items. Another specific appUcation would allow a person to 
customers. The present invention uses this to enable a have the visual experience of walking into a restaurant, 
viewer of a display screen to visually proceed through a sitting down at a table, opening up a menu and ordering as 
virtual embodiment of the store in a fashion similar to if the person were in the restaurant. The order could be 
walking up and down aisles at the actual store. The viewer 55 electronically transmitted for preparation for "carry out** or 
can view items on each aisle with the ability to move closer "delivery.** The restaurant could create a video image of 
to read images of actual labels on products on shelves or in each of its menu items for display upon activation of a 
displays. The digitization of the images generates electro ni- particular "hot spot" on the viewed menu. Unless otherwise 
cally stored data that allows for efficient substitution of new slated or limited by a particular stated context, the terms 
images if products are moved or changed in a store. Items 50 "shopping facility" and "store** as used in this specification 
that the store chooses to highlight, such as for "sale" or and the accompanying claims encompass all such places to 
"special** items, can flash or otherwise be made distinctive which the present invention is apphcable. The term "shop- 
as the customer approaches them on the virtual journey per" refers to a user of the present invention, 
through the displayed store. Preferred Embodiments of System and Method 

"Hot spots" are imposed upon the display screen, such as 65 An electronic shopping system in accordance with the 

at the location of the store price label for a particular product present invention is represented in FIG. 1. The system 

or at a logical location before a display of one particular creates an electronicaUy produced, electronically transmis- 
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sible visual replica of a display of goods or other objects at 
a shopping facility or other particular environment. The 
shopping facility is conveyed to a shopper through the 
present invention as a specific shopping environment to be 
met when the shopper is actually at the facility. This expe- 
dites the shopper moving through the actual facility because 
the shopper has familiarity with it. Any type of environment 
may be depicted; however, the present invention will be 
specifically described with reference to a conventional gro- 
cery store 2 having conventional aisles stocked with typical 
products 4. It is to be noted, however, that other items, such 
as business cards, product brochures, business information, 
machines, personnel, meeting or examination rooms, etc., 
can be depicted. 

The electronic shopping system of the present invention 
includes means 6 for converting images of the shopping 
facility into encoded digital signals representing the images 
as would be seen by the shopper at the physical embodiment 
of the shopping facility. The image converting means 6 can 
be used to provide any desired view that will produce a 
desired video replica of the shopping facility, particularly the 
interior environment and products of the facility. For 
example, the image converting means 6 can be used to 
generate electrical signals from which these features can be 
depicted at a distance for a broader view or close up to 
provide sufBcient clarity to read significant product labeling. 

A particular implementation of the image converting 
means 6 is a digital camera 8 shown in FIG. 2. This can be 
a conventional known type of product that generates, in 
response to the received light emitted or reflected from the 
shopping facility features, digital signals representing these 
detected images of the shopping facility. The image con- 
verting means 6 can be implemented in other ways, such as 
by a scanner device using a pictorial representation of the 
shopping facility or by a computer operator using a known 
type of graphics program to create images on a computer 
(e.g., the computer operator could draw an image based on 
a picture of an actual location or based on an artist's 
rendering, or as a fictitious place if actual shopping by the 
user is not to occur). It is preferred, however, to use a digital 
camera as illustrated in FIG. 2 so that a substantially exact 
representation of the actual facility can be quickly obtained 
and ultimately displayed in the electronic shopping system 
of the present invention. Known types of photographic (e.g., 
telescopic tensing) or digital imaging techniques can be used 
in creating long range or close up views with desired detail. 

The electric signals from the image conversion means 6 
are stored in a suitable storage means 10 preferably forming 
part of a computer data base. The storage means 10 can be 
implemented in any suitable manner, such as by one central 
memory or multiple distributed memories, or individual 
memories (e.g., diskettes or CD-ROMs provided to the 
shoppers for their individual use at home or business). The 
storage means 10 of whatever type is used within the system 
such that data can be removed and replaced as changes are 
made in the actual facility 2. 

The data from the storage means 10 is used to provide a 
video representation of the shopping facility as presented 
through a display means 12 as represented in FIG. 1. The 
display means 12 includes a video monitor of any suitable 
type, such as a computer monitor or a television screen, in 
conjunction with other conventional hardware and software 
that allow the downloading and use of the data from the 
storage means 10 in the display means 12. The information 
downloaded can be downloaded all at one time or incre- 
mentally as specifically required. Visible images can be 
displayed cither as still or moving images. Moving images 
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are used to give the shopper at the display means 12 the 
sense of moving through the aisles of products in the grocery 
store 2 example. 

The display means 12 is programmed to also include 

5 means for communicating information about the selected 
product to the shopper. This information communicated 
includes ordering information as well as other information 
as will become apparent below. The information communi- 
cated is information that has been previously entered into the 

10 data base of the storage means 10. The information can be 
conveyed audibly through speakers forming part of the 
display means 12 or visibly through the aforementioned 
monitor or other display device of the display means 12. 

The display means 12 also includes means for generating 
and displaying one or more lists of products ordered. These 
lists can be provided in alphabetical order, or in a sequence 
according to the locations of the ordered products in the 
shopping facility so that the shopper can go to the actual 
facility and efficiently and expeditiously move through the 
facility to obtain the items to be purchased. The lists can be 
organized in any other suitable manner as well. 

Another type of list that can be provided by the means for 
generating and displaying a list of the present invention is a 
list of products previously ordered by the shopper and the 
date each Listed product was last ordered by the shopper. 
This type of list can also indicate the frequency with which 
each Usted product has been ordered or is to be ordered by 
the shopper One implementation of this is to program the 
display means 12 so that actual ordering or selecting of 
products is automatically tracked and a frequency compu- 
tation made, such as either on the basis of the time since last 
ordering the same product or an average time based on a 
historical record of the orders for the same product. These 
lists are generated and displayed by suitable programming 
means within the display means 12 or as obtained from the 
storage means 10. 

The display means 12 can also display selected images 
that are visually distinctive relative to the video represen- 

40 tations of other images to highlight these images to the 
shopper at the display means 12. For example, certain 
products that arc on "special" at the grocery store 2 might 
flash on the display screen of the display means 12. 
Alternatively, there might be a text indication noting that 

45 such product is on special. Such distinctive display can be 
applied for other purposes, examples of which include goods 
that may need to be reordered, items that have been selected 
for current purchase, etc. This feature of distinctive display 
is implemented by means for modifying the respective 

50 encoded digital signals of the selected images so that the 
video representations of these selected images displayed by 
the display means 12 are visually distinctive to the video 
representations of other images not represented by modified 
encoded digital signals. The modification can be imple- 

55 mented by the tagging or linking technique referred to below 
whereby the programming commands which cause the 
image to flash or the "special" notification text to appear are 
Hnked with the respective signals defining the respective 
product image. 

60 The electronic shopping system shown in FIG. 1 also 
includes control means 14 for the shopper to control the 
display means 12 such that the display means 12 causes the 
displayed video image to change at the shopper's command 
to correspond to what the shopper would see were the 

65 shopper to move through the physical embodiment of the 
shopping facility 2. This includes a suitable interface device 
such as a mouse, keyboard, light pen, or touch screen 
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function that allows the shopper to indicate to the display readily usable by the shopper, and the computer 18 can be 

means 12 that other video representations are to be displayed of this type or larger depending upon data handling capa- 

or that a product is to be more closely exanained or ordered, bility required for a specific implementation. The printers 16 

for example. An example of this is to have the control means shown in FIG. 2 are of any desired conventional kiaown type 

14 allow the shopper to interact with the di^lay of one aisle 5 compatible with the respective computer 20 (e.g., laser, ink 

of the grocery store 2 with which a shopping cart image is jet, etc). 

also displayed. The control means 14 allows the shopper to The communication link connecting the data storage 

cause the display means 12 to move the shopping cart down computer 18 with the local computers 20 can include a 

the aisle as if the shopper were pushing it. The control means telephone line, cellular link, cable television or other con- 

14 further allows the shopper to cause the display means 12 jq nection medium, but in general the local computers 20 will 

to stop at a desired part of the aisle, turn toward that be remote from the data storage computer 18. As mentioned, 

particular part, and zoom in on a particular product. The the particular implementation of FIG. 2 uses the Internet 22 

control means 14 can also allow the shopper to cause the as the communication link. The computer 18 and the com- 

display means 12 to show movement of the selected product puters 20 have suitable known programs to interface with 

off the shelf for closer examination or for moving the ^5 the Internet and communicate over it to achieve the data 

displayed representation of the selected product into the acquisitions and transfers referred to in this specification, 

represented shopping cart in the same manner as the shopper xhe programming of the computer 18 and the computers 

would actually function in the real grocery store 2. The 20 is, in general, known conventional programming which 

shopping cart representation is a specific embodiment of a stores data, accesses data, communicates data, manipulates 

selected product accumulation space. Another embodiment 20 data, and displays data in manners known in the art. One 

of such a space is a counter in a clothing store where a cash significant aspect of the data handling is, however, that the 

register is located and where the shopper would collect digitized signals from the digital camera 8 need to be stored 

selected clothing items in moving them from the racks of in the data storage computer 18 in a manner which allows 

clothing to purchase them. This also provides means for particular portions of data associated with respective images 

ordering the selected products in that the display means 12 ^5 displayed through the local computer 20 to be identified and 

can record the selections and add them to an order list. The independently manipulated. One way to do this is to create 

control means 14 can provide for eliciting textual, graphical links or identifiers with the digitized video data so that it can 

or audible information about the product (e.g., puU-down be located and associated with other information. For 

menus or windows containing the information). example, identifiers can be spatial coordinates of the interior 

The electronic shopping system shown in FIG. 1 also 30 of the grocery store 2. As the data is recorded by the digital 

includes printing means 16 from which one or more selected camera 8 and stored in the computer 18, the data of a 

lists can be printed. This allows the shopper to take the particular portion of the store is associated in the data 

printed list and go to the actual grocery store 2 (or other storage computer 18 memory with a respective x-y-z coor- 

represented facility) to perform the actual shopping. The dinatc. Other identifiers could be manually assigned or 

present invention also contemplates, however, electronically 35 otherwise associated by a programmer looking at an image 

ordering the selected item so that the facility 2 receives the on the screen of the local computer 20 and clicking on areas 

electronic order, fiUs it and has the selected items ready for of products and assigning identifiers to those areas. In 

pick up by or defivery to the shopper as desired. whatever manner is chosen, this allows a particular product 

A particular implementation of the system shown in FIG. or other visual segment shown on the screen of a local 

1 is illustrated in FIG. 2. A representation of one actual aisle 40 computer 20 to have a unique identifier to which other 

of actual products 4 is digitized using the digital camera 8 information can be associated. For example, this other 

referred to above. The digital signals output from the digital information can be a set of encoded signals which cause the 

camera 8 arc provided to a data storage computer 18 respective product to flash when it is displayed on the local 

embodying the storage means 10 of FIG. 1. computer 20 to indicate that that product is being offered at 

The display means 12 and the control means 4 of FIG. 1 45 a special price or has been ordered or needs to be reordered, 

are implemented in FIG, 2 at least in part by one or more This also allows product information, selector "hot spots" 

local computers 20. A communication link, illustrated in and other features to be associated with respective products. 

FIG. 2 as the Internet 22, connects the data storage computer This allows, for example, a hierarchy of classifications to be 

18 with the local computers 20. The data storage computer assigned to each product (e.g., "canned goods," "green 

18, the one or more local computers 20 and the Internet 22 50 beans," "(specific brand name)") to facilitate text-based 

are used to embody the storage means 10, the display means searching for particidar products or types of products. This 

12 and the control means 14 of the FIG. 1 embodiment. still further allows for discrete or segmented replacement of 

Particular functions and structures of the system can be data; for example, when a certain product or group of 

implemented in either the data storage computer 18 or the products is changed in the actual store, a corresponding 

local computer 20 as desired; however, in general, the main 55 change can be made to the stored signals in the data storage 

data base of digitized signals provided from the digital computer 18 by replacing or modifying only that data at the 

camera 8 is contained in die central data storage computer 18 corresponding coordinates in the data base, 

and the control means 14 is part of each local computer 20 With the data entered, linked or tagged as described 

for the implementation of FIG. 2. The display occurs at the above, and formatted with appropriate associated 

local computer 20, but particular programming to accom- 60 information, the shopper at one of the local computers 20 

plish the functions of the present invention can reside in accesses the data storage computer 18 through the local 

either the computer 18 or the computer 20 as desired. The computer and communication link. In the particular 

computers 18 and 20 are of any suitable known type having implementation, this involves accessing a home page for the 

enough memory and operating speed to handle the amoimt grocery store 2 that is also stored iri the data storage 

of data used in defining the shopping facility and the 5S computer 18. To perform this access, the local computer 20 

operations performed therewith. Preferably each computer is turned on, the Internet is accessed by conventional Inter- 

20 is a personal computer type or other comparable type net access provider, and the address of the home page is 
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entered (e.g., http:/Avww.abcgroce ry.com). A home page 24 the shopper items to be reordered and on special. Means 

such as illustrated in FIG. 3 is then displayed, for example. other than the textual indicators of FIG. 7 can be used; for 

From the home page 24 illustrated in FIG. 3, the shopper example, the products can be made to flash or can be 

can "go shopping" or "make lists" or use a "product locator." highlighted m a predetermmed color. 

These are function selectors designed into the home page 5 When the shopper stops at a particular section to look at 

which connect the shopper to features of the present inven- ^ P^^^^^' f ''^<^^^^^<^ by left, right, forward or reverse 

tion illustrated in FIGS. lOA-lOB. f^^^ "1?^^ "f^^^g^ ^*?^ ^'f"^ 

r . T^^o -iftA J ^/vT, I t keyboard, a more limited, closer view of a section ot the 

Refernng to HGS. lOA and lOB, a shopper that goes ^isle can be viewed, such as shown in FIG. 8. Although not 

shopping" from the home page 24 shown m FIG. 3 can travel s^own in the representation of HG. 8 due to space and 

through the virtual store, look at specific products, request lettering constraints, the individual products, such as product 

more information about products, select products for 35^ appear on the display means as repHcas of the actual 

purchase, and make Usts. The shopper can also enter order products and include their labeling in sufficient definition 

information and print one or more lists. ^^^1 the labels can be read in at least close-up views. 

In traveling through the store, the shopper sees the interior ^ ^ Associated with each product or group of like products is the 

of the virtual embodiment of the store as displayed through corresponding price and information label 38 also in detail 

the respective local computer 20. At the beginning of a travel for reading in at least close-up views, 

through the store, the display can show entry through the An even closer view is shown in FIG. 9 in association 

front door of the store, selection of a topping cart, and vvith further information about a particular product and lists 

movement to a conventional starting point; however, pro- generated when products are selected. In FIG. 9, for 

gramming can be used to allow the customer to start at any example, each of the shelf labels 38 is a "hot spot" which 

selected point within the environment of the shopping causes a product information window 40 to be displayed 

facility 2. Additionally, programming can allow the shopper when the cursor 34 is placed on the shelf label "hot spot" and 

to travel down a main aisle and look down each stocked aisle clicked on. As shown in FIG. 9, the information can be 

to see images of the products and/or menus of products ^5 visibly shown as in window 40; however, audible informa- 

contained in that aisle. The shopper can then go down each tion can also be provided if the computer 20 has a speaker 

aisle as desired. The beginning of one such stocked aisle is and the data from the computer 18 data base contains data 

shown in FIG. 4. FIG. 5 shows another type of display of the for generating audio output. As another example, the product 

aisle including an index 26 of the items in the store, a list 28 may be graphically presented in response to actuating the 

of items on "special," and a list 30 of items to be ordered «hot spot"; for example, different discrete views of the 

based on a predetermined or a calculated frequency. FIG. 6 product can be sequentially shown in maximum close-up 

shows still another type of aisle display, this one including views with sufficient resolution and clarity to allow the 

a menu 32 of products available on that aisle. shopper to read product labeling. These are examples of 

In general, traveling through the store involves the pro- implementations of the means for communicating informa- 

gramming of one or more of the computers 18, 20 to 35 tion about a selected product and the means by which that 

determine the location of the shopper, access data, and selected product is identified. 

display the retrieved data. This involves data transfers To obtain data by which the different views shown in 
between the computer 18 and the respective computer 20 FIGS. 4-9 can be provided, the digital camera 8 can be 
whereby the desired data to be displayed is provided to the moved throughout the store to capture all of the images and 
local computer 20. One way to determine the location of the 40 this raw data stored in the computer 18. The computer 
shopper in the store is via a cursor 34 displayed on the screen programming is set up to define specific image ranges within 
as shown in FIG. 4. This location of the cursor 34 is oriented each location of the cursor 34 so that under shopper control 
relative to the computer program defined three-dimensional of the control means 14, the cursor location within the store 
space coordinate system set up for the shopping facility and can be noted and the images within the appropriate range of 
providing one means of identifying the digitally recorded 45 that location displayed. As the cursor 34 is moved and other 
images. Once the shopper enters the shopping facility, the control information given to the computer 18 or 20, move- 
computer 18 or 20 keeps track of where the cursor 34 is ment along an aisle and zoom in and zoom out views can be 
located within the virtual three-dimensional space and the shown. Alternatively, discrete segments of the store can be 
computer 18 or causes the associated data within a prede- stored in the memory and these discrete segments pulled up 
termined region of that location to be displayed, again such 50 and displayed as the cursor 34 reaches appropriate locations 
as illustrated in FIG. 4 (and FIGS. 5 and 6). That is, the within the three-dimensional coordinate system set up for 
computer programming can be defined with preset spatial the interior of the shopping facility, 
parameters that define the range of x-y-z coordinates to be As the shopper moves through the virtual store displayed 
shown at any given cursor location. This can be a fixed via the computer 20, products can be selected for purchase 
range, or different ranges depending upon the various posi- 55 such as by entering data through the product information 
tions within each aisle, for example, or as otherwise desired. window 40 as shown in FIG. 9 (i.e., by selecting "yes" after 
The present invention also allows for rotational orienta- "purchase") or by single or double clicking on the product 
tion so that if the shopper is in an aisle, looking in a or the "hot spot" in a distinctive manner from that xised for 
particular direction, the computer 20 displays that view. calling up the product information. A selection can then be 
Such rotational orientation can be implemented using the 60 automatically added to one or more lists, examples of which 
control means 14 such as specifically implemented by the are shown in FIG. 9. For example, the lists can be alpha - 
arrow keys on a keyboard or by a joy stick. Thus, as the betical (42), by store location (44), or by warehouse location 
shopper travels down the aisle from the end shown in FIG. (or other "order fill" location) (46). At least a list such as list 
4, different data is retrieved from the computer 18 (or from 30 also automatically lists the number of items ordered, the 
data previously downloaded to the computer 20) to show 6S unit cost and/or the total for each product, and a running total 
movement along the aisle as indicated by the scene in FIG. for the entire list. The programming for the computer 18 or 
7. Also shown in FIG. 7 is one technique for identifying to 20 can also allow the shopper to add notes to any of the lists 
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